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Problem we are addressing 

■ We are in the second year of our initiative and studying 

> Parameters that affect the results of inspection 

> The relation between V&V effectiveness in early lifecycle (e.g. 
inspection) and late (testing) 


We are using this information to provide feedback and decision 
support to NASA projects, on questions such as: 


> Can I get guidance on how to plan 
my inspections based on results 
from projects like my own? 



Based on my inspection results, 
what are the implications for the effort 
required to be spent on other non-optional 
activities, like system testing? 
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Unifying different defect classifications 

■ Motivation: Valuable defect data has been collected over the 
years across many Centers and projects 

■ Issue : Different defect classifications used in historic and 
contemporary data sets, as well as across Centers; 

■ Action : Definition of a unified defect classification schema and 
mapping of existing data sets into this unified schema 

■ Benefits: 

> Leverages data required by NPR 7150.2 for analysis and feedback to teams 

> Enables monitoring and validation of existing guidelines 

> Unified classification schema is applicable to inspections and testing 
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Map historical data to new categorization if possible; 
partition remaining historical categories and refine new 
schema if needed 
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Updating existing inspection standards 


NASA guidelines for effective inspections 
formulated in early 1990’s 

> Number of participants 

> Page rate 

> Meeting length 

Validating these standards based 
on a wider set of more recent data 


optimum 



unacceptable borderline 


acceptable borderline 
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Refining the standards - adding more variables, tailoring to 
different domains 



New standards built into 

> inspection support tool 

> inspection training 

Refined standards will increase effectiveness of inspections in 
terms of effort expended and defects found 
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Comparing test and inspection data 

Research Questions : 

■ What defects types are typically removed by inspections vs. 
testing? 

■ What project characteristics (size, language, software domain, 
new development/enhancements) influence the types of defects 



found? 

What percent of logic 
errors can be expected 
to be removed by 

inspections? 

Can test results be 

used for post-mortem 
analysis of 

inspection performance? 


Inspections Vs.Testing Defects By Type 
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■ Logic/control 
structures 

^ Internal interface 


■ Initialization 

□ External interface 

□ Data value or 
structure 

■ Computational 
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Providing an inspection experience base 



Choose subc ate gory: | Requirements 
Choose type: [Aii 
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Table of Contents 


About this Experience Base 
General Terms & Acronyms 
SI Tools & Resources 
AH 


Filter by title: 

Filter by description: 
Filter by date: 

7 item(s) found 
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Forms & Templates 
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Inspections Repository 
£ Training & Services 
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Full EB Access 
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Contact EB manager: 
fs hnO@fc-md. mud, edn 
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Improving tool support for inspections 
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Accomplishments so far 


2529 unified inspection records in database 

> more data sets are welcome 


Initial tool that supports inspection planning and reporting 

> (test) users are welcome to try the tool 

■ Tool can accept data from JPL forms as well as various 
databases 

> possibility of later integration into NASA’s eRoom 

■ Central inspection experience base available 

> http://fc-md.umd.edu/EB 

■ Accepted papers at ESEM and IEEE Software 

> additional publications are currently under review or planned 



More details are provided as part of 
our technical presentation 
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Contact information 


Forrest Shull (PI) Sally Godfrey (NASA POC) 

fshull@fc-md.umd.edu sara.godfrey@nasa.gov 
301 - 403-8970 301 - 286-5706 

Myrna Regardie 

mregardie@fc-md.umd.edu 

301 - 403-2050 



Inspection Experience Base on-line at: 
http://fc-md.umd.edu/EB 
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